Metadata-driven Statistics Processing 


Field of the invention 

The invention relates to management of data transport 
services, and in particular to methods of generating 
5 statistical information for data network performance 
management report. 


Z Background of the invention 

The deregulation of telecommunications services has 
lead to a competitive environment in which data transport 
10 service providers deploy data services to subscribers and 
co-operate in supporting subscribed- to services. 

Data transport networks are made up of data transport 
Z links interconnecting data transport equipment. A variety 
of data transport technologies exist for the physical 
15 conveyance of data over data transport links, a variety of 
data transport protocols exist for data transfers between 
data network nodes and a variety of data transport 
equipment produced by different vendors must coexist in 
order to support subscribed- to services end-to-end. 

20 The development of the physical data transport 

technologies, the data transport protocols and the data 
transport equipment has progressed in support of specific 
data transport features. Feature development is driven by 
customer demand and the vendors' need to differentiate 

25 themselves, balanced against a requirement for 
interoperability between different vendor equipment. 
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Interoperability between mult i -vendor equipment is 
necessary between core data network equipment and 
distribution-side equipment. Different segments of data 
transport networks operate according to different data 
transport requirements using different data transport 
technologies typically on different vendor equipment. 

Data service providers offering customized data 
transport services have recognized that loyalty to a 
single vendor's equipment may reduce operational costs but 
may not accommodate all customer requirements. Therefore 
mult i -vendor equipment interoperability is necessary even 
within the realm of a single service provider in order to 
take advantage of opportunities. 

Besides the need for interoperability in provisioning 
the data transport services, there is a need for 
interoperability for data network management purposes. 
Although data transport services are provided in 
accordance with open standards for interoperability, the 
approach taken by each data transport equipment vendor in 
implementation may be different. Performance measurement 
and reporting has a different meaning for each vendor. 
Each vendor equipment typically provides vendor specific 
performance reporting and requires adjusting vendor 
specific controls. 

Therefore a lot of resources are necessary to achieve 
interoperability between data transport equipment within 
and between data transport networks in order to support 
subscribed-to data services. 

In particular, for data network management, a large 
amount of statistical information such as is generated by 
managed data network elements is processed to: extract a 


current state of the managed data network elements, log 
the statistical information, display the current state of 
the managed data network elements, isolate current 
problems, monitor trends that could lead to potential 
5 problems, determine solutions to problems, issue commands 
to correct problems, deploy newly activated subscribed-to 
services, etc. Effective performance management systems 
need to provide a single view of the state of the managed 
data network elements across physical data transport 
10 networks, data transport protocols, currently deployed 
data services and currently established data sessions. 
This field is known as performance management reporting. 

As the managed data network elements are manufactured 
by different vendors, it is of crucial importance that the 
15 generated statistical information is extracted 

effectively. 

- z Prior art methods in the field of extracting 

statistical information are limited to explicit coding of 
parsing software to transform the statistical information 

20 from a vendor specific data format to a performance 
management system data format for display. Several 
drawbacks are encountered in using this approach. 

Typically new services are provisioned over already 
installed resources; in order to support the new services 

25 new parsing software is necessary to be coded in support 
of the new services . Upgrades of managed data networking 
elements also necessitates re-coding of the parsing 
software. Upgrades in the performance management 

system (s) yet again necessitates re-coding of the parsing 

3 0 software. Further, re-coding the parsing software is 
necessary in order to support new data network equipment. 
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With different vendors rolling out upgrades ■ and 
improvements several times a year, re-coding the parsing 
software adds to the overhead in providing data services 
to end customers. 

5 Therefore, there is a need for methods of reducing 

the overhead involved in providing effective performance 
reporting . 

Summary of the invention 

In accordance with an aspect of the invention, a 
10 method of generating statistic information for performance 
management reporting is provided. The method includes a 
semantic extraction step. Performance reporting 

statistics are extracted from common format statistics 
according to statistic semantic mappings having semantic 
15 translation priorities specified in a body of statistics 
3 semantic mapping metadata. 

If common format statistics are not found in a body 
of common format statistics as specified by a currently 
selected statistic semantic mapping having a greatest 
20 semantic mapping priority, another statistic semantic 
mapping having a next greatest semantic mapping priority 
is chosen until either a semantic mapping priority is 
satisfied or no other statistic semantic mapping are 
available . 

25 In generating performance reporting statistics, the 

method further includes a step of performing operations on 
common format statistics. 

In accordance with another aspect of the invention, 
the method further includes selecting performance 
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reporting statistics from a body of performance reporting 
metadata, each, performance reporting statistic having a 
performance reporting statistic identifier used in 
selecting statistic semantic mapping for the generation of 
performance reporting statistic. 

In accordance with another aspect of the invention, 
the method includes a syntactic translation step in which 
raw statistic information provided by a managed network 
element is converted into a body of common format 
statistics as specified in a body of vendor statistics 
metadata for each raw statistic. Each raw statistic is 
associated with a vendor statistic identifier, the vendor 
statistic identifier being used to query the vendor 
statistic metadata in performing the syntactic 
translation. 

In performing the syntactic translation, raw 
statistics may be subject to unit conversions. 

The advantages of the invention are derived from: a 
reduction in the overhead involved in upgrading vendor 
data network equipment in a managed data network segment, 
a reduction in the overhead involved in adding other 
vendor equipment to the managed data network segment and a 
reduction in the overhead associated with changes in 
performance reporting characteristics in managing the 
performance of the managed data network elements . 

Brief description of the diagrams 


The features and advantages of the invention will 
become more apparent from the following detailed 


description of the preferred embodiments with reference to 
the attached diagrams wherein: 


FIG. 1 is a schematic diagram showing interconnected 
data network elements in a data transport network in 
5 accordance with an exemplary embodiment of the invention; 

FIG. 2 is a schematic diagram showing an overview of 
the processing of statistical information for performance 
management reporting in accordance with a preferred 
embodiment of the invention; 

10 FIG. 3 is a schematic diagram showing raw statistical 

information provided by a managed data network element; 

FIG. 4 is a schematic diagram showing a tabular 
representation of vendor statistics metadata in accordance 
with an exemplary embodiment of the invention; 

15 FIG. 5 is a schematic diagram showing a tabular 

T representation of statistical information stored in a 

common format in accordance with an exemplary embodiment 

of the invention; 

FIG. 6 is a schematic diagram showing a tabular 
20 representation of performance management metadata in 
accordance with an exemplary embodiment of the invention; 
and 

FIG. 7 is a schematic diagram showing a tabular 
representation of statistics semantic mapping metadata in 
25 accordance with an exemplary embodiment of the invention. 

It will be noted that in the attached diagrams like 
features bear similar labels. 
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Detailed description of the embodiments 

FIG. 1 is a schematic diagram showing interconnected 
data network elements in a data transport network in 
accordance with an exemplary embodiment of the invention. 

5 Data network elements 100 are managed and provide 

performance statistic information 102 to a performance 
management system 104 . Data network elements include but 
are not limited to: data switching nodes, access 

concentrators, routers, bridges, etc. 

10 FIG. 2 is a schematic diagram showing an overview of 

the processing of statistical information for performance 
management reporting in accordance with a preferred 
embodiment of the invention. 

The statistic information 102 provided by a 
15 management network element 100 describes a current state 
.s thereof in a format specified by the vendor of the network 
= element 100 and will be referred to herein as raw 
jl statistical information 102 . 

The content of the raw statistical information 102 
20 provided may vary, as specified by the vendor, in 
accordance with modes of operation of the network element 
100. Further details about the raw statistical 

information 102 will be presented hereinbelow with 
reference to FIG. 3. The performance management system 
25 104 may monitor a multitude of managed network elements 
100 . 

In accordance with invention, each raw statistic 
provided in the raw statistical information 102 is 
described in a body of vendor statistics metadata 200. 
30 Further details regarding the vendor statistics metadata 
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200 will be presented hereinbelow with reference to FIG. 
4 . 

For the purposes of performance reporting, the vendor 
statistics metadata 200 is consulted in performing a 
5 preliminary syntactic translation 202 of the raw statistic 
information 102. 

The raw statistic information 102 is represented in a 
common data format 2 04 subsequent to the syntactic 
translation step 202. The body of common format 

10 statistics 2 04 no longer retains the original vendor 
syntax (data format) but still retains vendor semantics 
(meaning of the information represented by the statistic 
data) . Further details with respect to the common format 
statistics 204 will be presented hereinbelow with 

15 reference to FIG. 5. A unit conversion step 206 may have 
to be performed in generating the common format statistics 
204 . 

~ Typically, what is reported by the vendor equipment 

might not be exactly what is necessary in performance 

20 management reporting. It is likely that what needs to be 
presented in performance management reporting is a 
combination of the raw statistic information provided by 
the vendor . 

In accordance with the invention, the performance 
25 report statistic information 214 displayed in a report 
(reported statistic information) is described in a body of 
performance reporting metadata 208. Further details 

regarding the performance reporting metadata 2 08 will be 
presented hereinbelow with reference to FIG. 6. 


In accordance with the invention, a body of 
statistics semantic mapping metadata 210 is further 
provided to enable a semantic extraction 212 of 
performance report statistics 214 from the common format 
5 statistics 204. Further details regarding the statistic 
semantic mapping metadata 210 will be provided hereinbelow 
with reference to FIG. 7. 

FIG. 3 is a schematic diagram showing raw statistical 
information provided by a managed data network element. 

.J-0 The raw statistical information 102 may be provided 

as: a continuous data stream having a repetition rate, 
data transfers provided on a regular basis, query 
responses, etc. Shown in the diagram are portions of raw 

-~ statistic information files 102 produced by a data 
15 switching node 100. 

For the purposes of this example, the data switching 
* node 100 is not a source of data in the data transport 
network in which it participates. As such the data 
switching node 100 can only: receive Protocol Data Units 
20 (PDUs) , forward PDUs and discard PDUs . PDUs include but 
are not limited to: frames, cells, packets, etc. 

As mentioned above, the content of the statistical 
information 102 provided may vary as specified by the 
vendor in accordance with modes of operation of the 
25 managed network element 100. 

An example of content variance is the provision of 
raw statistic v37 in a raw statistic information file 102 
and its replacement with raw statistic v34 in another 
(subsequent) raw statistic information file 102. 
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FIG. 4 is a schematic diagram showing a tabular 
representation of vendor statistics metadata in accordance 
with an exemplary embodiment of the invention. 


The vendor statistics metadata 200 is represented in 
5 tabular format. The invention is not limited thereto, 
persons of ordinary skill in the art would recognize that 
other methods of representing metadata may be used without 
departing from the spirit of the invention. A vendor 
statistics metadata table 200 is typically provided for 
10 each vendor/ equipment type combination. The correlation 
.1 between a particular vendor statistic metadata table 2 00 
and raw statistic information file 102 is made using 
information provided by the vendor in a file header of 
each one of the raw statistic information files 102. 

15 The vendor statistics metadata table 200 includes row 

~ entries 4 00. Each row entry 4 00 includes: a vendor 
]_ statistic identifier specification, a statistic unit, a 
== vendor description of the statistic (semantic 

information), and a common format statistic identifier. 
20 Other information may be stored as necessary to facilitate 

the syntactic translation of the raw statistic information 

102 into the common format statistics 2 04 without 

departing from the spirit of the invention. 

For example, details about raw statistics v34, v37, 
25 v87 and v92 are shown: raw statistic v34 represents a 
number of PDUs received by the data switching node 100, 
raw statistic v37 represents a, number of PDUs forwarded by 
the data switching node 100, raw statistic v87 represents 
a number of PDUs discarded by the data switching node 100 
30 and vendor statistic v92 represents a number of time ticks 
since the last restart of the data switching node 100. 
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Raw statistics v34, v3 7, v87 and v92 have unit 
specifications uOO, uOO, uOO and ul7 respectively as 
provided by the vendor. For example, ul7 represents a 
unit of time specifying the duration of one time tick. 
5 Different units may be specified for different raw 
statistics even within a single raw statistic information 
file 102. As an example, the passage of time may be 
specified in microseconds, seconds, etc. and referenced to 
the GMT, the UMT standard, etc. 

10 The vendor statistics metadata 200 is not limited to 

Z' what is shown in FIG. 4, additional information may be 

held as it facilitates the syntactic translation 202 of 

the raw statistic information 102 into the common format 

statistics 204. Of importance are vendor statistic 
15 qualifiers (not shown) which provide extended information 

about the vendor statistics such as the type of counters: 
» rolling, interval, differential, etc. The meaning of 
- rolling, interval and differential counters is know to a 

person of ordinary skill in the art who understands that 
"20 such information may be added to or taken away from the 

vendor statistics metadata 200 without departing from the 

spirit of the invention. 

Also held in each row entry of the vendor statistics 
metadata table 200 is a common format statistic identifier 
25 facilitating the syntactic translation of the raw 
statistic information 102 into the common format 
statistics 204. As an example raw statistics v34 , v37, 
v87 and v92 have common format statistic identifiers 
cfOOOl, cf0002, cfOOOO and cf8423 respectively. 

30 The use of vendor statistics metadata 200 reduces the 

overhead in re-coding parsing software for interpreting 
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raw statistical information 102 with: changes in vendor 
provided statistic information, - the addition of data 
equipment from other vendors to a managed data network 
segment, etc. 

5 FIG. 5 is a schematic diagram showing a tabular 

representation of statistical information stored in a 
common format in accordance with an exemplary embodiment 
of the invention. 

The syntactic translation step 202, as presented 
10 above, generates common format statistics 2 04 a tabular 
f representation of which is shown to include row entries 
1 500. The invention is not limited to the tabular 
representation of the common format statistics 204 and a 
person of ordinary skill in the art would appreciate that 
15 other representation of common format statistics 204 may 
be used without departing from the spirit of the 
' invention. 

=> Each common format statistic entry 500 includes at a 

minimum a statistic value and the corresponding common 

20 format statistic identifier. The particular common format 
statistics 204 shown correspond to the first raw statistic 
information file 102 presented in FIG. 3: common format 
statistic common format statistic identifier cfOOOO has a 
statistic value of 200, common format statistic common 

25 format statistic identifier cf0002 has a statistic value 
of 300 and common format statistic common format statistic 
identifier cf8423 has a statistic value of 4213417. The 
common format statistics 2 04 retain the vendor semantics 
but the associated values may have been subject to unit 

3 0 conversion (206) in the syntactic translation step 2 02. 
The storage of units in entries 500 is optional since the 
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unit conversion step 206 provides a normalization of 
vendor provided units. 

FIG. 6 is a schematic diagram showing a tabular 
representation of performance reporting metadata in 
5 accordance with an exemplary embodiment of the invention. 

Typically performance management reporting statistic 
information is presented to an analyst in the form of a 
performance report . 

In accordance with the invention the presentation of 
-10 the performance management reporting statistic information 
in the performance report is described in a body of 
performance reporting metadata 208. In the diagram the 
performance reporting metadata 2 08 is represented in 
- tabular format. The invention is not limited to the 
15 tabular representation thereof and persons of ordinary 
skill in the art would appreciate that other 
representation of performance reporting metadata exist and 
« may be used without departing from the spirit of the 
invention. 

20 The performance reporting metadata table 208 includes 

row entries, each row entry 600 storing specifications of 
a report field identifier corresponding to a performance 
report statistic identifier. A performance report field 
descriptor (semantic information) may also be provided as 

25 well as other information aiding in the presentation of 
performance management report statistic information in the 
performance report . 

In accordance with the example shown, the performance 
report field identifiers f23, f26, f84, and f94 correspond 
30 to report fields which are to be populated with values of 
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performance report statistics having performance report 
statistic identifiers rl54, r383, r227 and r527 
respectively . 

The use of performance reporting metadata 208 reduces 
5 the implementation overhead in modifying performance 
reports for performance management reporting purposes and 
eliminates the need for explicit re-coding of performance 
management reporting interfaces with each upgrade, changes 
in service offerings, and/or the addition of new equipment 
10 to a managed data network segment. 

:" FIG. 7 is a schematic diagram showing a tabular 

representation of statistics semantic mapping metadata in 
accordance with an exemplary embodiment of the invention. 

In accordance with the invention, a body of 
15 statistics semantic mapping metadata 210 is provided for 
extracting (212) performance report statistics 214 for 
performance management reporting purposes from a body of 
* common format statistics 204. The extraction process step 
is also known as a semantic translation step (212) as 
2 0 performance report statistics 214 having performance 
report semantics are generated from common format 
statistics 2 04 having vendor provided semantics. 

The representation of the statistics semantic mapping 
metadata 210 is not limited to the tabular format shown 
25 and persons of ordinary skill in the art would appreciate 
that other representations may be used without departing 
from the spirit of the invention. 

Row entries 700 in the statistics semantic mapping 
metadata table 210 specify how the common format 
30 statistics 204 are to be used to generate performance 
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report statistics 214. As examples, for the generation of 
performance report statistics corresponding to performance 
report statistic identifiers rl54, r227, r383 and r527, 
the statistics values corresponding to common format 
5 statistic identifiers cfOOOO, cfOOOl, cf0002 and cf8423 
may be used directly. 

As mentioned above, the content of the raw 
statistical information files 102 may differ with changes 
in modes of operation of the managed network equipment 10 0 
10 and typically what is reported therefrom may not exactly 
; correspond with what is required in performance management 
- reporting but combinations of the provided raw statistical 
information 102 may fulfill that requirement. 

In accordance with the invention, each statistics 
15 mapping specified in the statistics semantic mapping 
Z metadata 210 is given a semantic mapping priority. The 

statistics mappings referred to above are shown in the 
=- diagram to have a semantic mapping priority of "1" . A 

semantic mapping preference of "1" is considered to be the 
20 greatest semantic mapping preference, a statistic semantic 

mapping having a semantic mapping preference of "2" would 

be considered to have a next greatest semantic mapping 

preference, and so on. 

Should a common format statistic identifier specified 
25 in the statistic semantic mapping metadata table 210 not 
be found in the common format statistics table 204, the 
statistics extraction process consults the statistics 
semantic mapping metadata table 210 for another row entry 
corresponding to the same report statistic identifier 
30 having a next greatest semantic mapping priority. 
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In the example shown, each of the performance report 
statistic identifiers rl54, r227 and r383 also have 
entries 700 bearing semantic mapping priorities of "2" . 
With response time being an issue of importance in the 
5 example, semantic mapping priorities of "2" are given to 
statistics semantic mapping entries 700 which require 
calculations to generate performance report statistics. 
For this purpose, row entries 700 in the statistics 
semantic mapping metadata table 210 include specifiers for 
10 operations to be performed as well as the common format 
statistic identifiers corresponding to the common format 
statistics on which the operations are to be performed on. 

Persons of ordinary skill in the art would recognize 
that more than one operation may be specified in the 

-15 statistic semantic mapping and/or unit conversions may be 
performed in generating the performance report statistic 

~ without departing from the spirit of the invention. 

7 As an example, the performance report statistic 

* corresponding to the performance report statistic 
20 identifier r227 may also be generated by adding the 
statistic value corresponding to the common format 
statistic identifier cfOOOO to the statistic value 
corresponding to the common format statistic identifier 
cf0002 as specified in the common format statistics 204. 

25 In summary of the above example and in accordance 

with the invention, the statistics semantic mapping 
metadata 210 is used as follows: in reporting the number 
of PDUs received at the data switching node 100 preferably 
use the number of PDUs received if provided in the raw 

30 statistics information (subject to a unit conversion) . 
Failing that, and therefore less preferably, use the 
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result of adding the number of PDUs discarded to the 
number of PDUs forwarded, if provided, in the raw 
statistics information (subject to any necessary unit 
conversions) . Continue trying to determine the value of 
5 the performance report statistic by inspecting the 
statistic semantic mapping metadata 210 for less 
preferable ways obtaining the performance report 
statistic. Return a failure in determining the value of 
the performance report statistic only on not finding 
10 suitable combinations of common format statistics to 
satisfy at least one statistic semantic mapping in the 
statistics semantic mapping metadata 210 corresponding to 
the performance report statistic needed to be reported. 

The use of statistics semantic mapping metadata 

15 reduces the overhead in hard coding routines for 
extracting performance report statistics from raw 

- statistic information and reduces the overhead in re- 
coding thereof with upgrades, changes in service offerings 

Z and the addition of new equipment to managed data network 

SO segments . 

The use of the methods described herein also aid in 
supporting other features of performance management 
reporting systems 104 such as error reporting, error 
propagation, raising of alarms, etc. 

25 The invention is not limited by the information held 

in the statistic semantic mapping metadata 210 shown, 
persons of ordinary skill in the art would appreciate that 
further information may be added thereto without departing 
from the spirit of the invention. 

3 0 The embodiments presented are exemplary only and 

persons skilled in the art would appreciate that 
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variations to the above described embodiments may be made 
without departing from the spirit of the invention. The 
scope of the invention is solely defined by the appended 
claims . 
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